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A Hybrid Machine/Human Computing Arrangement 

CROSS-REFERENCE TO RELATED APPLICATIONS 

This non-provisional application claims priority to provisional application 
5 60/276,963 filed March 1 9, 2001 , having the same title and inventorship as the 
present application. The specification of the above provisional application is 
incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

10 

1. Field of the Invention 

The present invention pertains to the field of distributed computing. More 
specifically, the present invention relates to a new form of hybrid distributed 
15 computing involving one or more humans to assist a computer in solving a task, 
such as, for example, speech to text conversion, allowing the computer to solve the 
task in a more efficient manner. 

2. Background Information 

20 

Traditional computers excel at tasks that are easily expressed by simple 
algorithms. For example, traditional word processing involves tasks that are easily 
expressed in terms of programming instructions that are machine executable. The 
instructions operate to handle user inputs in accordance with specific algorithms that 
25 represent the tasks that the computer will perform. For instance, when a text 

document is scanned by a word processor for spelling errors a computer processor 
executes specific instructions that result in verification whether user inputs conform 
to specific pre-determined character patterns, producing outputs to the user 
indicating where there are mismatches between user inputs and the pre-determined 
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character patterns. There are many similar examples. In each, a computer 
processor uses simple algorithms to do the processing. 

However, there are many tasks that are difficult for a computer processor to 
perform, even if many computer processors are combined in a distributed computer 
5 network or some other computer architecture. Such tasks include, among others, 
speech to text conversion, speech recognition, image comparison, and music 
comparison. While it may be a straightforward task for a human to describe the 
differences and similarities between two pictures, for example, automating the same 
task on a computer is overly complex and can appear insurmountable. There are a 
1 0 variety of reasons for this, but there tend to be three major underlying reasons. 
fn First, there is not an efficient way of representing human knowledge in a form that 
# computers can understand and use. Second, existing algorithms for many of these 
rj tasks take so long to execute on a computer that the algorithms are rendered only 
«J marginally useful. Third, there is insufficient understanding as to how the human 
M- 1 5 brain processes information to make it possible to easily transfer these processes to 
= * computers. 

Q Finding solutions to these underlying issues has been the focus of artificial 

III intelligence research for many years. However, research and development has 
H been directed to improving the algorithms used by computer processors to complete 
20 various tasks the have been desireable but difficult to automate, increasing the 
performance capabilities of the computer processors themselves, and optimizing 
computer architectures by using multiple computer processors. While advances 
have been made, the three underlying issues above have not been satisfactorily 
addressed. 

25 Thus, better methods and apparatuses are needed to help solve the type of 

problems that tend to be almost trivial for humans but difficult to automate using 
computers. 
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SUMMARY OF THE INVENTION 

A hybrid machine/human computing arrangement including a central 
coordinating server and a number of human operated nodes, is provided to involve 
5 humans to assist a computer system to solve particular tasks, allowing the computer 
system to solve the tasks more efficiently. 

In one embodiment, the computer system decomposes a task, such as, for 
example, image or speech comparison, into subtasks for human performance, and 
programmatically requests the performances, using an API of the present invention. 
10 In response, the central coordinating server dispatches the subtasks to personal 
computers operated by the humans, by way of e.g. the Internet. 

The humans perform the requested subtasks and provide the results back to 
the central coordinating server. The central coordinating server receives the 
responses corresponding to human performance of the subtasks, and generates a 
15 result for the task based at least in part on the human performances of the 
subtasks. 
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BRIEF DESCRIPTION OF DRAWINGS 

The present invention will be described by way of exemplary 
embodiments, but not limitations, illustrated in the accompanying drawings in which 
5 like references denote similar elements, and in which: 

Figures 1-2 illustrate an overview of the present invention; 
Figure 3 illustrates one embodiment of the Application Programming 
interface (API) associated with a hybrid machine/human computer; and 

Figure 4 illustrates the operational flow for a Junta Computer in 
10 accordance with one embodiment. 
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DETAILED DESCRIPTION OF THE INVENTION 

In the following description, various aspects of the present invention will 
be described. However, it will be apparent to those skilled in the art that the present 
5 invention may be practiced with only some or all aspects of the present invention. 
For purposes of explanation, specific numbers, materials and configurations are set 
forth in order to provide a thorough understanding of the present invention. However, 
it will also be apparent to one skilled in the art that the present invention may be 
practiced without the specific details. In other instances, well-known features are 
10 omitted or simplified in order not to obscure the present invention. 

Parts of the description will be presented using terminology commonly 
employed by those skilled in the art to convey the substance of their work to others 
skilled in the art, such as node, server, client, and so forth. As well understood by 

15 those skilled in the art, this terminology is merely logical in nature to facilitate 

explanation of the present invention. Parts of the description will also be presented in 
terms of operations performed by a computer system, using terms such as network, 
text, data and the like. As well understood by those skilled in the art also, these 
quantities take the form of electrical, magnetic, or optical signals capable of being 

20 stored, transferred, combined, and otherwise manipulated through mechanical and 
electrical components of a digital system; and the term digital system includes 
general purpose as well as special purpose data processing machines, systems, and 
the like, that are standalone, adjunct or embedded. 

25 Various operations will be described as multiple discrete steps 

performed in turn in a manner that is most helpful in understanding the present 
invention, however, the order of description should not be construed as to imply that 
these operations are necessarily performed in the order they are presented, or order 
dependent. Lastly, repeated usage of the phrase "in one embodiment" does not 

30 necessarily refer to the same embodiment, although it may. 
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Referring now to Figures 1-2, an overview of the hybrid 
machine/human computer 100 of the present invention in accordance with one 
embodiment is shown. As illustrated, hybrid machine/human computer 100 
5 comprises Task Server 1 02 associated with Junta Computer 1 04. For this 
embodiment, Junta Computer 104 is that portion of the hybrid machine/human 
computer that comprises functional components other than Task Server 102. In one 
embodiment, Task Server 102 resides at a remote premise accessible to a user 
wishing to utilize Junta Computer 104 to solve a problem or a task, by way of a 

10 networking fabric, such as the Internet. In an alternate embodiment, Task Server 
102 is co-resident with the user. Task Server 102 is at the front end of a hybrid 
machine/human computer and functions to decompose the task to be performed 
into smaller, potentially many, subtasks to be performed by Junta Computer 104. 
As will be disclosed in greater detail below, the subtasks represent basic operations 

15 that any human can trivially perform without any special training or education. That 
is, the subtasks are generated in such a fashion as to be relatively simple for a 
human to perform as compared to a computer. Put another way, the task or 
problem is broken down into smaller sub-problems that may be easily solved by a 
human very rapidly, in almost no time at all. Examples of such subtasks or basic 

20 operations include, among others, classifying text into one of many categories, 
comparing music samples, comparing images, and converting speech into text. A 
more specific example of a subtask is the act of determining whether two images 
are photographs of the same person. 

Decomposition of a task into subtasks may be performed manually by 

25 an operator of Task Server 1 02 or automatically by a task decomposition application 
(not shown) executing on Task Server 102. Such task decomposition application 
may decompose a task in any one of a number application dependent manner. 
Preferably, the manner in which such task decomposition decomposes a task is 
user configurable and/or selectable. That is, task decomposition application is 

30 equipped with a number of ways to decompose a task, and the user may specific 
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which of the available options is to be employed. For example, in an example 
application of dispatching archive articles to humans for classification, the task 
decomposition application may decompose the tasks into subtasks by day ranges, 
month ranges or year ranges. Preferably, which timing granularity to be employed is 
5 user specifiable or selectable. 

In accordance with one embodiment, Task Server 102 sends the 
subtasks to be performed to Junta Computer 104, whereby communication is 
directed to that functional portion of Junta Computer 104 called Junta Server 106. 
In one embodiment, communication link 108 is implemented using the Internet. In 
10 another embodiment, communication link 108 is implemented using a local area 
network such as Ethernet. In yet another embodiment, Task Server 102 and Junta 
Server 106 are in a single computer and share a common computer processor, in 
which case communication link 108 is a system bus, embedded in the common 
computer. 

15 Those skilled in the art will appreciate that the functional components 

of the present invention can be implemented in many different embodiments. For 
example, Task Server 102 may be implemented as a single computer or as a 
collection of several distributed computers or, for a plurality of task servers, as 
multiple independent computers, each task server independently transacting with 

20 Junta Server 106 or using other system architectures. Likewise, Junta Server 106 
may be implemented as a single computer or as a collection of distributed 
computers or using other system architectures. 

Junta Server 106, as shown in Figure 1, serves as the central 
coordinating computer of the Junta Computer 104. Junta Server 106 receives the 

25 subtasks from Task Server 102, determines the availability of Junta Node 1 1 10 to 
perform the subtask using network communications 112, and, if Junta Node 1 110 is 
available, sends the subtask to, and receives the resulting response from Junta 
Node 1110 using network communications 112. Junta Server 106 similarly 
determines availability of other Junta Nodes such as Junta Node 2 114 through 

30 Junta Node n 116, where n is the n th Junta Node, and Junta Server 106 similarly 
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sends each node a subtask and receives from each a corresponding response. 
Once Junta Server 106 receives a sufficient number of responses from Junta 
Network 118, which comprises the network of Junta Nodes, as shown, Junta Server 
106 puts together all the responses collected and sends a result for the subtask 
5 back to Task Server 1 02, thereafter Task Server 1 02 is then enabled to solve the 
problem based on the solution received for each of the subtasks. 

As an overview of a hybrid machine/human computer, the illustration 
of Figure 1 is complemented with Figure 2, which illustrates one embodiment of 
Junta Node 1 110 in closer detail and therein highlights a method of involving 
10 humans to assist a computer. As illustrated in Figure 2, in accordance with one 
embodiment, Junta Server 106 communicates with Junta Node 1110 through 
i communication device 202 using network connection 204. Communication device 
JjJ 202 then interacts with human 206, wherein interaction 208 is text visually displayed 
P by communication device 202 and alterable by human 206 using a keyboard or 
^ 15 interaction 208 is sound projected from communication device 202 and text input by 

human 206 using a keyboard or interaction 208 is any output from communication 
H device 202 and any input from human 206. 

H For example, in one embodiment, communication device 202 is a 

pj personal computer. Most personal computers provide for visual and audio outputs 
M20 and human inputs using a keyboard, mouse, microphone, and so on. In another 

embodiment, communication device 202 is a handheld computing device such as a 
personal digital assistant (PDA) with visual outputs and only accepting inputs using 
a touch screen feature. In yet another embodiment, communication device 202 is a 
handheld communication device such as a cellular phone that allows for two-way 
25 audio, visual outputs, and keypad inputs. In one embodiment, network connection 
204 is a cellular phone or Internet enhanced cellular phone network. In another 
embodiment, network connection 204 is the Internet. In yet another embodiment, 
network connection 204 is a combination of wireless local area network and Internet, 
to connect, for example, a PDA to a local area network with Internet access. 
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Even though Figure 2 characterizes Junta Node 1 110 as having 
human 206 coupled with communication device 202, this need not be the case for 
Junta Node 2114 through Junta Node n 116. In one embodiment, Junta Node 1 
110 is as illustrated in Figure 2 whereas Junta Node n 116 comprises a computer 
5 system whereby the computer system performs the subtask communicated from 
Junta Server 106. In another embodiment, Junta Node 1 110 follows as 
characterized in Figure 2 whereas Junta Node n 116 comprises a human coupled 
with a computer whereby the computer system performs the subtask communicated 
from Junta Server 106. 
10 As illustrated in Figure 1, in one embodiment, Junta Server 106 is the 

?= , intermediary between Task Server 1 02 and Junta Network 1 1 8. Junta Server 1 06 
%| performs several functions, including, but not limited to: 1) coordinating availability 
Q of Junta Nodes comprising Junta Network 118; 2) verifying inputs received from 
{[! Junta Nodes comprising Junta Network 1 18; 3) rating the power of Junta Computer 
Hl5 104; 4) calculating and disbursing payments to Junta Nodes comprising Junta 

Network 1 18; 5) maintaining records of transactions, transactions with Task Server 
pi 102, other task servers, and individual Junta Nodes; 6) storing data associated with 
H Task Server 102, other task servers, and individual Junta Nodes comprising Junta 
q Network 118; and 7) other miscellaneous book keeping activities. 
*"20 In coordinating availability of Junta Nodes, Junta Server 106 keeps 

track of all Junta Nodes that have registered with Junta Server 106 as being 
available to perform subtasks. Registration may be facilitated in any one of a 
number of registration techniques know in the art. Upon registering, in accordance 
with one embodiment, each Junta Node provides additional capabilities, such as, for 
25 example, language spoken. Junta Server 106 identifies the Junta Nodes that have 
registered and fit within the scope of particular subtasks, such as, for instance, 
language spoken. Those Junta Nodes registered and that meets minimum basic 
prerequisites, comprise Junta Network 118. In other words, the collection of Junta 
Nodes employed to solve one task may be different from that of another task. Junta 
30 Server 1 06 sends each Junta Node in Junta Network 1 1 8 choices of subtasks 
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available for performance and the compensation associated with each subtask. 
Alternate embodiments allow for different combinations as to the type of choices 
offered to Junta Network 118. In one embodiment, each Junta Node in Junta 
Network 118 is able to choose which subtasks are to be performed, making such 
5 choices considering relevant data such as compensation level offered for 
performance of each subtask. 

Communications between Junta Server 106 and the Junta Nodes may 
be conducted using any one of a number of known client-server communication 
techniques. For example, in one implementation, Junta Nodes may be equipped 
10 with a generic browser, whereas Junta Server 106 may include a web server, where 
communication between Junta Server 106 and Junta Nodes may be conducted via 
web pages. 

In verifying inputs received from Junta Nodes, Junta Server 106 
collates the responses received from Junta Nodes in Junta Network 118 responding 

15 to the same subtask. In one embodiment, Junta Server 106 uses a simple algorithm 
that determines the correct solution to be that solution which is most popular, 
wherein the "majority wins" (also referred to as "majority governs", that is the result 
provided by the most number of Junta Nodes is determined to be the correct answer 
for the task, or an algorithm that determines the correct answer using Junta Node 

20 responses weighted according to the history of each particular Junta Node in 

coming up with the right answer previously, effectively weighting each Junta Node 
response by an accuracy rating for that Junta Node. Additionally, the final answer 
may be generated in accordance with a "specific accuracy," using e.g. an algorithm 
selecting a solution that represents "at least N" Junta Node responses in agreement, 

25 where N is the integer number of responses in agreement (assuming the subtask 
has been dispatched to M Junta nodes for performance, where M is greater than N). 

In rating the power of Junta Computer 104, in accordance with one 
embodiment, Junta Server 106 bases its power rating on the number of registered 
30 Junta Nodes participating in the Junta Computer, along with other adjustments for 
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Junta Node capability, Junta Node historical accuracy or accuracy rating, and so 
forth. The power rating represents the computing power available from Junta 
Computer 104 for the particular subtask being considered. This is analogous to the 
FLOP rating or clock speed used to rate traditional computers. 
5 In one embodiment, Junta Server 106 also calculates the 

compensations for the Junta Nodes. In accordance with one embodiment, Junta 
Server 106 determines the compensation due and disbursement method for each 
Junta Node participating in Junta Computer 104, taking into consideration data for 
each Junta Node, such as cumulative contribution to Junta Computer 104, quality of 
10 the work contributed, and other parameters agreed to between Junta Server 106, 
the particular Junta Node involved, and Task Server 102 or the particular task server 
involved. 

In maintaining records of transactions, Task Server 102, in accordance 
with one embodiment, uses database or data storage features to catalog and 

15 maintain transaction data associated with Task Server 102, other task servers, and 
all individual Junta Nodes. 

Regarding handling other miscellaneous book keeping activities, Junta 
Server 106, in one embodiment, records data relevant to security and privacy and 
performance measures, such as, for instance, throughput, latency and accuracy. 

20 Junta Server 106, in one embodiment, stores such performance data as throughput, 
defined as the number of subtasks completed by Junta Computer 104 in a unit time, 
latency, defined as how long it would take to obtain the solution to a subtask once it 
has been submitted to Junta Computer 104, and accuracy, defined as an accuracy 
rating for Junta Computer 104 as a whole rather than accuracy ratings for Junta 

25 Nodes, also tracked and maintained by Junta Server 106. 

Regarding security and privacy, Junta Server 106, may, in one 
instance, receive data from Task Server 102 indicating Task Server 102 requests no 
special security or privacy for one task yet desires low level or lax security and 
privacy protection for another task. Such low level protection includes, in 

30 accordance with one embodiment, Junta Server 106 ensuring that only relevant data 
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is passed from Task Server 102 to Junta Computer 104. For example, if Task 
Server 102 wishes to use Junta Computer 104 to clean certain fields in a database 
containing sensitive information, only the data containing the fields to be cleaned 
are sent to Junta Computer 104. Should Task Server 102 desire strict security or 
5 higher-level protection, Junta Server 106, in accordance with one embodiment, uses 
Secure Sockets Layer (SSL) for all communication with Junta Network 118 using 
network 112. 

The aforementioned functions of Junta Server 106 are enabled by 
algorithms, programming instructions, and data in accordance with an Application 

10 Programming Interface (API). A permanent copy of the programming instructions to 
practice the present invention, in one embodiment, may be loaded into non-volatile 
storage associated with Junta Server 106, Task Server 102, similar task servers, or 
any computer system associated with Junta Computer 104 in a factory, or in the 
field, through distribution source/medium such as tapes, CDROM, DVD, and so 

15 forth, and through network connection 1 12 or network connection 108. 

The Application Programming Interface (API), in one embodiment, 
provide facilities to enable Task Server 102 to programmaticaily describe to Junta 
Server 106, selected details of the task to be solved, e.g. the nature of the task at 
hand, the input data associated with the task to be performed, the accuracy 

20 expected of the results that are sent back, the desired security level, the maximum 
amount of time to be spent for a subtask, the cost to be incurred for a task, and so 
forth. The API also provides for facilities to enable return communication from Junta 
Server 106 to Task Server 102. 

Effective communications and interactions involving the various 

25 systems and sub-systems associated with hybrid machine/human computer 100 
require an API that establishes certain ground rules and protocols. Figures 3a-3b 
provide the essential aspects of an API in a C like programming language, in 
accordance with one embodiment. 

For the embodiment, the API provides for various data types. Typedef 

30 declarations 302, 304, 306, 324 and 326 provide for the establishment of the data 
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types junta_input_domains_t, junta_output_domains_t, junta_function_s, 
junta_input_data_s, and junta_output_data_s, respectively, for various declared 
variables and data structures. Variables/data structures of these types may assume 
one of the enumerated/defined data values. That is, variables of the type 
5 juntaJnput_domains_t may assume "text" or "speech", whereas variables of the 
\ypejunta_output_domains_t may assume "text", "numbers", and "tuples", specifying 
the nature of the input and output data. Data structures of the type junta_function_s 
comprise data of variables with the types junta_input_domains_t and 
junta_output_domains_t. Data for the variables of type junta_input_data_s and 

10 junta_output_data_s are specified by the pointers pointed to by pointers "*text" and 
"*speech_data", and pointers "*numbers" and "*text" respectively. Together, these 
data types junta_input_domains_t, junta_output_domains_t, junta_function_s, 
junta_input_data_s and junta_output_data_s facilitate programmatic communication 
between Task Server 102 and Junta Server 106 on input and output data, including 

15 their types, for a problem to be solved by Junta Computer 100. In alternate 

embodiments, additional input and output data types, such as video, may also be 
defined and supported. 

Additionally, for the embodiment, typedef declarations 310, 312, 314, 
316, 318, and 320 provide for the establishment of the data types 

20 junta_attribute_type_t, junta_accuracy_functions_t, junta_security_level_t, 

junta_accuracy_s,junta_security_s, and junta_attribute_s respectively, for various 
declared variables and data structures. Variables and data structures of these types 
may assume one of the enumerated/defined data values. That is, variables of the 
typejunta_attribute_type_t may assume "ACCURACY", "SECURITY", and so forth. 

25 Variables of the type junta_accuracy_function_t may assume "MAJORITY_WI Ns", 
"SPECIFIC_ACCURACY", and so forth, whereas variables of the type 
junta_security_level J may assume "STRICT", "LAX", and so forth. Variables/data 
structures of the types junta_accuracy_s, junta_security_s, and junta_attribute_s 
may take on the accuracy, security and consolidated attribute values 

30 correspondingly as defined. Together, these data types juntajattributejypej, 
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junta_accuracy_functions_t,junta_security_level_t,junta_accuracy_s, 
junta_security_s, and junta_attribute_s facilitate programmatic communication 
between Task Server 102 and Junta Server 106 on various attributes, such as 
security, accuracy and so forth, for a problem to be solved by Junta Computer 100. 
5 In alternate embodiments, additional attribute types and/or attributes may be 
supported. 

For the embodiment, the API also includes function 
junta_new jproblem 308 to facilitate Task Server 102 to request Junta Server 106 to 
create a new task to be performed or a new problem to be solved. Among the 

10 invocation parameters is the parameter "functionjype" having the earlier described 
data type junta_function_s, and the parameter identified by pointer "*problem_id" 
having the data type juntajd. Returned data for the "create" request, such as 
status, may be found in junta_return_t. 

The API also includes function junta_set_attributes 322 to facilitate 

15 Task Server 102 to specify for Junta Server 106 the various attributes associated 
with a task to be performed or a problem to be solved. In addition to the 
task/problem identifier "problem_id", the invocation parameters include 
"attributejype" and "attributes" (having data types junta_attribute_type_t and 
junta_attribute_s respectively). 

20 Further, the API also includes functions juntajnput 328 and 

junta_set_output 330 to facilitate Task Server 102 to provide and specify for Junta 
Server 106 the input data and the range of the output data associated with a task to 
be performed or a problem to be solved. The API also includes function 
junta_get_output 332 to facilitate Task Server 102 to retrieve from Junta Server 106 

25 the output data for a task performed or a problem solved. In the case of juntajnput 
328, in addition to the task/problem identifier "problemjd", the invocation 
parameters include the input data "input" (with the data type junta_input_data_s). In 
the cases of junta_set_output 330 and junta_get_output 332, in addition to the 
task/problem identifier "problemjd", the invocation parameters include the output 

30 data "output" (with the data type junta_output_data_s). 
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Next, Figure 4 illustrates an operational flow of a hybrid 
machine/human computer arrangement in accordance with one embodiment. First 
is task server identification of the problem 402, followed by task server generation of 
5 subtasks 404. Moving to the functions handled by Junta Computer 406, Junta 
Server identifies resources 408 needed by Junta Computer 406. For examples, the 
task on hand requires French speaking humans, and Task Server has requested 
that each subtask be performed by at least 10 humans with a past accuracy record 
of at least 90%, Junta Server identifies the Junta Nodes meeting the criteria 
10 accordingly. If more Junta Nodes are available than the number Junta Nodes 
needed, the subtask may be assigned randomly, or by some fairness algorithm, 
ensuring most Junta Nodes of equal quality/accuracy are given substantially the 
same amount of work. 

Upon identifying the Junta Nodes to be assigned to subtasks, Junta 
15 Server then sends subtasks to each of the identified resources (Junta Nodes) 41 0, 
those resources comprising Junta Network 412. Junta Node 1 414, Junta Node 2 
416, through Junta Node n 418, which are the Junta Nodes comprising Junta 
Network 412, each perform their respective assigned subtasks. 

Upon completing performance of the assigned subtasks, each of the 
20 Junta Nodes sends the result or results back to the Junta Server. Junta Server, in 
due course, receives all responses 420 from the Junta Nodes comprising Junta 
Network 412. Thereafter, Junta Server compares and analyzes the responses, and 
determines/synthesizes the result for the task. As described, the comparisons, 
analyses as well as syntheses may take into consideration the accuracy desired, as 
25 well as past accuracy of the Junta Nodes providing the answers. 

Finally, upon deriving an answer for the requested task, Junta Server 
returns the derived solution to the Task Server 

As an example application using the operational flow in Figure 4, 
consider a task involving the comparison of images. First, the task server identifies 
30 the problem 402 that needs to be solved by Junta Computer 406. Next, the task 
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server generates subtasks 404. For this example, consider that one specific 
subtask is the comparison of two image files, requiring a determination whether a 
certain individual pictured in one image file is the same person pictured in the other 
image file. Once subtasks have been generated, these subtasks are sent to the 
5 Junta Computer 406 via the Junta Sever. In this example, the communication from 
task server to Junta Server as well as from Junta Server to individual Junta Nodes is 
in the form of electronic mail messages containing attachments for the image files. 
The Junta Server then identifies the resources 408 available to complete the 
subtasks. For example, the Junta Server might reference a data base containing 

10 information about Junta Nodes that have previously expressed interests in image 
comparison subtasks and have previously agreed to certain arrangements regarding 
level of compensation, timing for receiving new subtasks and providing responses 
back to the Junta Server, logistics such as receiving subtasks and providing 
responses using electronic mail, and so forth. 

15 After resources are identified 408, the Junta Server sends the same 

subtask to n different Junta Nodes, wherein the number of Junta Nodes, n, is 
determined when the problem was identified by the task server 402. For example, it 
might be desirable for "at least n" Junta Nodes to produce the same result in order 
for a solution to be considered valid. This is an accuracy attribute identified by the 

20 task server 402. To make sure that at least n solutions in agreement are received, 
the Junta Server will need to keep sending subtasks to Junta Network 412 until at 
least n solutions are received 420. Each Junta Node receives an email with image 
attachments, opens the attachments, determines whether the two images contain 
the specified individual, and replies to the Junta Server using an electronic mail 

25 message. Once at least n solutions in agreement are received, the responses are 
sent to the task server for analysis 422. Lastly, once analysis is complete, the task 
server presents a solution to the subtask. 

The above example using electronic mail messages sent out by the 
Junta Server to the Junta Nodes is an example of a push system. That is, the Junta 

30 Server pushes the subtasks out to the Junta Nodes, using the electronic mail 
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messages sent to request action from the Junta Nodes comprising the Junta 
Network. 

In contrast, a pull system can be implemented, in one embodiment, by 
establishing queues of subtasks residing at the Junta Server, awaiting performance 
5 by Junta Nodes that access the Junta Server to query whether subtasks are 

available to be performed. That is, the Junta Server pulls the Junta Nodes into the 
Junta Server environment to find subtasks to be performed. For example, a pull 
system might be implemented using a website on the Internet, the website 
representing the Junta Server, where Junta Nodes can access the website using 
10 dial up or whatever Internet access is available, query the Junta Server for available 
subtasks and relevant compensation and other arrangements, and provide 
responses to subtasks using the Internet website. 

Thus, a hybrid machine/human computing arrangement has been 
15 described. While the present invention has been described in terms of the above- 
illustrated embodiments, those skilled in the art will recognize that the invention is not 
limited to the embodiments described. The present invention can be practiced with 
modification and alteration within the spirit and scope of the appended claims. The 
description is thus to be regarded as illustrative instead of restrictive on the present 
20 invention. 
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